go 
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false. This latter principle is ‘unhealthy’, because human beings need to hold 
fallible beliefs in order to function successfully. (In my [19754], p. 311, I gave 
an example of a reason why someone might ‘need to know’ what the correct 
theory of Atlantic was; if necessary, one could construct another hypothetical 
situation with the same methodologically-problematic features but in which 
the motive for finding the true theory at one or both levels was much more 
tangible and pressing.) What people need from the philosophy of science is a 
set of principles showing how to choose beliefs which are relatively ‘good’ in 
some sense} scepticism of the Popperian kind is part of a methodology which, 
arguably, serves just this purpose, but the stronger scepticism entazfed by 
d’Agostino’s remarks conflicts with that need. 

The principle that theories should be rejected whenever they are less than 
ideal from the methodological point of view, regardless of whether methodo- 
logically-preferable alternatives are available, is likely in practice to require the 
rejection of all theories ever constructed in any domain (Lakatos [1970]). 
D’ Agostino perhaps means only to argue that rejection of all extant alternatives 
is appropriate just when the methodologically-superior alternative at one level 
is incompatible with the methodologically-superior alternative at another 
level, as I suggest may be characteristic for linguistics in particular. But if 
agnosticism is not in general justified by the fact that all extant theories in a 
given domain are in some way or other methodologically imperfect, what is it 
about the special kind of methodological difficulties in my example that makes 
agnosticism permissible here? 


GEOFFREY SAMPSON 


University of Lancaster 
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AD HOCNESS AND THE APPRAISAL OF THEORIES * 


I THE BAYESIAN ANALYSIS OF AD HOCNESS. 


In a recent note Schaffner ([1974]) has given a formal discussion of the notion 
of ad hocness in terms of a Bayesian model for the appraisal of theories. Schaffner 
develops his general ideas in the context of a critique of Zahar’s [1973] which 
was concerned with the particular problem of comparing the Einstein and 


* T am grateful to Donald Gillies, Jon Dorling and Noretta Koertge for helpful comments 
and suggestions. The present work formed part of a paper read in Professor Watkins’ 
seminar at The London School of Economics in January 1976. 
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Lorentz research programmes. Zahar suggests the following analysis of ad 
hoeness!: 
Ad hoc,: A theory is said to be ad hoc, if it has no novel consequences as 
compared with its predecessor. 
Ad hocy: [A theory]...is ad hoc, if none of its novel predictions have 
been actually ‘verified’. 
Ad hoc,: [A]... theory is said to be ad hoc, if it is obtained from its 
predecessor through a modification of the auxiliary hypotheses which docs 
not accord with the spirit of the heuristic of the programme. 


Zahar explains the meaning of novelty as follows? 


A fact will be considered novel with respect to a given hypothesis if it did 
not belong to the problem-situation which governed the construction of 
the hypothesis. 


Schaffner begins his elucidation by discussing the notions of ad hoc, and ad 
hocg. The first he describes as a logical dream, since the novel consequences of 
a theory cannot in practice be ‘surveyed’, so the question of whether a theory 
is ad hoc, can only be discussed relative to the extent to which novel consequences 
bave been looked for at the particular epoch of the evaluation. Ad hoc, Schafiner 
claims to be ‘vague to the point of inapplicability’. For Schaffner ad hoc, is 
‘close to the sense in which ad hoc is used in science’ and he announces that his 
Bayesian analysis will be brought to bear on this sense of ad hoc. 

Denoting by p(7/6 & e) the probability of a theory T to be true in the light 
of background knowledge 4 and the positive outcome e of some experiment not 
part of 6, by (7/6) the prior assessment of 7, by p(e/7T & b) the probability of 
obtaining e given T and 4, and by p(e/b) the probability of obtaining e on the 
basis of background knowledge alone, Schaffner writes 


: _ P(T/b)-ple/T & ) 
AT} &) (2) 
If T explains e we can set p(e/T & 6) = 1 so in this case we obtain 
p(T /b & e) = p(T/b)/p(e/b) (2) 


Schaffner proceeds to discuss ad hocness as a property of an hypothesis as a 
constituent part of a theory, but in order to keep the argument as simple as 
possible we shall follow Zahar in considering the ad hocness of theories. Trans- 
lated into these terms Schaffner’s idea is that a theory T gives an ad hoc explana- 
tion of an experimental result e if p(T/d) is close to zero and p(e/4) is significantly 
larger than p(7'/b). The argument for p(7/2) being small is that it has no ‘theo- 
retical support’ (or indeed empirical support other than e itself). This looks 
suspiciously like a reference to ad hocs, and Schaffner now appears to be claiming 
that a theory is ad hoc, partly in virtue of its being ad hoc,. So he is not really 
giving an independent analysis of ad hoe, at all. 


1 Zahar [1973], p. ror. In his [1974] Zahar rephrases his definition in terms of a notion 
of empirical non-ad hocness expressed as a three-place relation between an observation 
statement, a theory and a heuristic. See also in this connection the very clear account 
of empirical support given by Worrall in his [1978]. However this more recent work 
has somewhat obscured the important distinctions drawn by Zahar in his [1973]. 


? Zahar [1973], p. 103, 
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The lack of novelty in the prediction of ¢ is associated by Schaffner with a 
high value for p(e/b). On Zahar’s account this is a necessary condition for lack 
of novelty, but not a sufficient condition. We proceed to show how using 
Zahar’s notion of novelty one can get an ‘internal’ Bayesian analysis of ad hocg. 

We express Bayes’s theorem in the following familiar way 

p(T /b) + p(e/T & b) 
PUTO 6) = Serr eb) pT Ib) + Bel ~ T &D)-p ~ TB) @) 
where ~ T denotes the negation of T. 

We follow Schaffner in interpreting p(A/B) as the degree of belicf that A 
is true given that B is true. Note also that ¢ is supposed in equation (3) to refer 
to a prediction made by the theory T (we could perhaps write e, to emphasise 
this important point) so p(e/~ T & b) means the probability that the prediction 
e, derived from the theory 7 is a true prediction given that the background 
information 6 is true but the theory T is false (i.e. its consequences are not 
guaranteed to be true although ‘by accident’ they may be true). 

Writing p(T /b) = x, ple/~T & b) = « 
and taking p(e/T & b) = 1 and using p(~ T/b) = 1—x 


p(T /b & e) = career =a (4) 


We define an enhancement ratio y by 
_ p(T /b & e) 
p(T /b) 
whence using (4) we obtain the simple result 
I 


= x-+-e(1—2) 


(5) 
We can now explain that if a theory T is ad hoc, with respect to the experiment 
e then « = 1, ze. the explanation of e by 7 in no way depends on the truth or 
falsehood of 7, both of which eventualities lead with certainty to the result e. 
This is just what a scientist means when he says T was an ad hoc explanation of 
e, namely T was devised for the express purpose of explaining e, so the explana- 
tion of e is guaranteed independently of whether 7 is true or false. To show the 
consistency of our analysis if we put « = 1 in (5) we get y = 1, so the posterior 
and prior probabilities of T are equal (there is no enhancement) and this again 
is just what we expect from an ad hoc explanation of e, namely e itself gives us 
no additional information for assessing the truth of 7.1 

Notice that p(e/b) = #-|-¢(1--*) is equal to unity if «e = 1, but that p(e/b) = 1 
is achieved for # = 1 whatever the value of «, so the explication of novelty in 
terms of low p(e/b) (Schaffner) and small « (Zahar) are by no means equivalent. 

On our analysis if « <« <1, then y ~ 1/e, so in this case we get a big 
enhancement and the theory is far from being ad hoc. Noting that under these 


¥ 


1 What we have shown is that « = 1 is a necessary condition for T to be an ad hoc, ex- 
planation of e. To justify « == 1 as a sufficient condition we must invoke a principle of 
insufficient reason, v7z., if there is no reason for the community of scientists to entertain 
with non-vanishing prior probability only theories which explain e, then they will not 
so constrain their choice of alternative theories, 
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conditions p(e/b) ~ «, we sce that this is a situation in which Schaffner would 
claim that the theory was ad hoc, which highlights the way in which his analysis 
differs from ours. Effectively Schaffner requires yx to be small as his condition 
of ad hocness. Ie is thus concerned with the absolute value of the probability 
of a theory after it has explained some experimental finding. If this absolute 
value is still small the theory is to be regarded as an ad hoc explanation of the 
experiment. On our account the important aspect in assessing ad hocness for 
this case is not the absolute value of the probability but the enhancement ratio. 
Our point against Schaffner is not that his analysis may not explicate some 
legitimate sense of the ambiguous appellation ad hoc, but that it fails to explicate 
Zahar’s very important notion of ad hoc,. There is no inconsistency here on 
Schaffner’s part, since he finds Zahar’s account of ad hoc, inadequate in respect 
of the definition of novelty involved with its historical associations, but we 
would maintain that Zahar’s sense of ad hoc, is the one that ought to be ex- 
plicated since it is the one most importantly used in science. 


2 THE CASE OF MULTIPLE PREDICTIONS 


To develop our analysis a little further we can consider how a theory builds up 
a favourable appraisal as it makes a number of successful predictions ¢, é2. . . 
say. Denote by p, the posterior probability p(7/b & e, & e...&e,) after s 
successful predictions. Assuming for simplicity that successive appraisals 
are all associated with the same value of «, we can clearly write 


Da y A yorD a y®, Po 
where ) = x according to our previous notation 


and (2) — — 
¥ Ps-1 (x —«)+e 
Psu = et "Ps 
The solution of this recursion is by inspection or more simply by replacing ¢ 
by e” in the formula for p, (see (4) above). We obtain? 
I 


bn = Tepe (6) 


We can also ask what is the probability for the (w+1)th prediction e,, being 
correct if the theory has already made n successful predictions ¢. . .e,. Denoting 
this probability by p(e,4,) we clearly obtain the result 

I—e 


Plena) = See (7) 


If ¢ is a small quantity (#.e. < 1) which will be the case if T is non-ad hoc, with 
respect to all the predictions, we can write the following formulae which will 
be perfectly satisfactory for the subsequent discussion 


eee 
I-e/x 


Pn (8) 


1 This result will be recognised as a special case of the general treatment given by Keynes 
in his [1921], pp. 235-6, 
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PlEnta) = €+-Pn (9) 
I 
ee (10) 
We note the following features 
(1) The value of p, depends entirely on the ratio <"/x. 
For e"/x > 1, Py < 1 and for e"/x < 1, py & I. 
At the critical point «” = x we have p, ~ 1/2. 
So if initially x < © as n increases p, will rise steeply as we reach the value 
n = Inx/Ine. 
(2) So long as p, < ¢ we have p(é,4) X ¢, but as p, builds up towards unity 
so does p(é,43). 
(3) So long as p,-, < «, y ~ 1/e, but as p,-, builds up towards unity the 
enhancement factor y™ also tends to unity. 


To take a concrete case we illustrate in the accompanying figure p, and p(ép 41) 
as functions of # for the particular choice x = 0-01, © = O-1. 
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3. QUANTITATIVE PREDICTIONS 


We can apply this analysis to the important case of quantitative predictions.1 
Suppose a theory 7' predicts correctly an experimental result which is known 
to an accuracy of n significant figures. We assume as part of our background 
knowledge that the order of magnitude of the result is known, z.¢. we disregard 


1The successful detailed quantitative predictions of a theory in respect of phenomena 
quite different from those which the theory was originally proposed to deal with have 
always attracted the attention of scientists. To take an example at random, in referring 
to his early work on the ground state of helium Hylleraas comments in his [1963] (p. 42) 
‘The end result of my calculation was... greatly admired and thought of as almost a 
proof of the validity of wave mechanics... in the strict numerical sense’. 


BL 
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the prediction of zeros occurring before or after the significant figures in the 
experimental result. As a concrete illustration we cite the theoretical predictions 
by quantum electrodynamics of the anomaly in the hydrogen spectrum known 
as the Lamb shift and the anomaly in the magnetic moment of the electron. 
For example the latter is now known experimentally to be (11596524+2) 
10-19 Bohr magnetons! whereas the theoretical prediction is (11596524+ 
6) 10-0 Bohr magnetons.2 We thus have remarkable agreement to seven 
significant figures. Clearly if we regard the prediction of each significant figure 
as an independent event then the appropriate value to take for ¢ is o-r since a 
false theory would have ten equal possibilities for filling in each digit. The 
question of what value to take for x is somewhat arbitrary. In agreement with 
Schafiner we do not follow a purely logical approach and set x = 0. For our 
purpose » reflects the scientist’s confidence in the new theory 7. One could 
argue that a scientist would not spend great efforts developing the consequences 
of a theory he did not believe in. By analogy with the situation in the Bayesian 
analysis of significance testing (see for example Redhead ([1974]) we could 
take x — 4. Perhaps more realistically we should take « around 0-01 and adopt 
the sociological rule that unless a scientist has a one per cent level of confidence 
in the truth of his theory he would not seriously investigate it.3 With this 
choice of parameters we see that the build-up of confidence in a theory which 
makes correct quantitative predictions, as the accuracy of the experiment 
increases, would be illustrated by the graph for p, in the figure.* Of course 
P(én41) 18 only given by our analysis so long as other factors which could potent- 
ially influence the results are known not to be significant. For a certain value 
of » this condition will fail. For example in the case of the anomalous magnetic 
moment of the electron the effect of hadronic couplings introduce theoretical 
uncertainties which would ultimately make the prediction of the theory un- 
reliable. 


CONCLUSION 


The concept of a novel prediction plays a very important part in the way 
scientists assess their confidence in theories. Our analysis has shown how the 
intuitive appraisal by scientists in this respect can be understood if degrees of 
commitment are governed by Bayesian rationality constraints. 

M. REDHEAD 


Chelsea College 


1Van Dyck et al. [1977]. 

2 See value quoted in Calmet et al. [1977]. For a good account of the fluctuating agreement 
between theory and experiment the reviews by Lautrup, Peterman and de Raphael 
[1972] or Rich and Wesley [1972] may be consulted. 

3 We may refer to Shimony’s concept of commitment to a theory (see his [1970], pp. 94— 
5). The degree of commitment measures the scientist’s belief that the theory T belongs 
to the equivalence class of all theories which give the same true observational predictions 
within the domain of current experimentation and that the ‘true’ theory ‘generalises’ 
in some sense the concepts embodied in T. Commitment measures our belief, not that 
a theory is true, but that it points the way to the truth. 

* It is easy to see that our confidence in a theory at a given level of accuracy for agreement 
between theory and experiment does not depend on the particular scale of notation used 
to express the result. 

5 According to Rich and Wesley ([1972]) the known hadronic contribution to the electron 

anomaly would affect the tenth significant figure. 


Ad Hocness and the Appraisal of Theories 361 


REFERENCES 


CaLMErT, J., Narison, S., PerrorretT, M. and pr Rapnagt, E. [1977]: ‘The Anomalous 
Magnetic Moment of the Muon: A Review of the Theoretical Contributions’, 
Reviews of Modern Physics, 49, 21-9. 

Hy ueraas, E, A. [1963]: ‘Reminiscences from Early Quantum Mechanics of Two- 
Electron Atoms’, Reviews of Modern Physics, 35, 421-31. 

Keynes, J. M. [1921]: A Treatise on Probability. 

Lautrup, B, E., Pererman, A. and pe Rapuagt, E. [1972]: ‘Comparison between Theory 
and Experiment in Quantum Electrodynamics’, Physics Reports, 3C, 195-250. 
Repueap, M. L, G, [1974]: ‘On Neyman’s Paradox and the Theory of Statistical Tests’, 

The British Journal for the Philosophy of Science, 25, 265-71. 

Ricu, A. and Westy, J. C. [1972]: “The Current Status of the Lepton g Factors’, Reviews 
of Modern Physics, 44, 250-83. 

ScuaFrner, K. F. [1974]: ‘Einstein versus Lorentz: Research Programmes and the 
Logic of Comparative Theory Evaluation’, The British Journal for the Philosophy of 
Science, 25, 45—78. 

Summony, A. [1970]: “Scientific Inference’, in R. G. Colodny (ed.): The Nature and 
Function of Scientific Theories, 79-172. 

Van Dyck, Jr., R. S., Scuwinperc, P. B. and Deumect, H. G. [1977]: ‘Precise Measure- 
ments of Axial, Magnetron, Cyclotron, and Spin-Cyclotron-Beat Frequencies on 
an Isolated I-meV Electron’, Physical Review Letters, 38, 310-14. 

WorraLt, J. [1978]: “The Ways in which the Methodology of Scientific Research Pro- 
grammes Improves on Popper’s Methodology’, in Radnitzsky and Andersson (eds.): 
Progress and Rationality in Science. Dordrecht: D. Reidel. 

Zanar, E. G. [1973]: ‘Why did Einstein’s Programme Supersede Lorentz’s?’, The 
British Journal for the Philosophy of Sctence, 24, 95-123 and 223-62. 

Zauar, E. G, [1978]. ‘Einstein’s Debt to Lorentz: A Reply to Feyerabend and Miller’, 
The British fournal for the Philosophy of Science, 29, 49-60. 


erin 


